OXFORD JOURNALS 


OXFORD UNIVERSITY PRESS 


KG nesican Aceaciatian for Pahlie-Ocinioa h 


Characteristics of Hard-to-Reach Individuals in Field Surveys 

Author(s): George A. Lundberg and Otto N. Larsen 

Source: The Public Opinion Quarterly, Vol. 13, No. 3 (Autumn, 1949), pp. 48/-494 
Published by: Oxford University Press on behalf of the American Association for Public 
Opinion Research 

Stable URL: http://www.jstor.org/stable/2745725 

Accessed: 28-08-2016 01:17 UTC 


JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content in a trusted 
digital archive. We use information technology and tools to increase productivity and facilitate new forms of scholarship. For more information about 


JSTOR, please contact support @jstor.org. 


Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at 


http://about.jstor.org/terms 


American Association for Public Opinion Research, Oxford University Press are 
collaborating with JSTOR to digitize, preserve and extend access to The Public Opinion Quarterly 


This content downloaded from 216.165.126.13 on Sun, 28 Aug 2016 01:17:17 UTC 
All use subject to http://about.jstor.org/terms 


Characteristics of 
Hard-to-Reach Individuals 


in Field Surveys 


BY GEORGE A. LUNDBERG AND OTTO N. LARSEN 


Following a survey of status relationships in a small town in the State of 
Washington, a systematic follow-up was made in an effort to interview respondents 
who were not available during the original survey. From the follow-up sample 
of 200 individuals, data on less than one-third could finally be obtained, even 
after repeated efforts. Refusals, moves out of town, inability to locate, inability 
to contact, and “too old’ accounted for a large share of those who could not be 
reached. Those in the follow-up sample who were finally interviewed did not 
differ markedly from those contacted in the original survey with respect to 
personal characteristics and responses, although certain types of variation are 


suggested by the data. 


The senior author, well known for his writing in Sociology, 1s Head of the 
Department of Sociology at the University of Washington. Mr. Larsen is a Re- 
search Fellow, engaged in communications research, at the same University. 


In every field study involving inter- 
viewing, a certain percentage of the in- 
dividuals that it is planned to interview 
turn out to be, for one reason or an- 
other, uncooperative or unavailable. The 
question arises as to what extent the re- 
sults of the study might have been 
different if the cases required by the 
sample, but not interviewed, had been 
included. That is, how different, if at 
all, in respect to the characteristics un- 
der study, are the hard-to-reach, uninter- 
viewed cases as compared with the cases 
interviewed? 

In the nature of the situation, since 
these cases are either difficult or im- 
possible to reach, not much is known 
about their characteristics in comparison 
with the population reached.* Certain in- 
ferences and deductions may be made 


on the basis of the known character- 
istics of the whole population as re- 
vealed by standard census figures and 
other data that may exist in particular 
cases. But in studies of attitudes and 


1A thorough survey of available literature 
and data on “hard-to-gets” has been made by 
P. J. McCarthy (mimeographed report, Cor- 
nell University, February 20, 1947). C. W. 
Birnbaum and M. Sirken of the University of 
Washington have proposed ingenious methods 
of estimating the possible extent of errors 
due to this problem. (‘‘Bias Due to Non-Avail- 
ability in Sampling Surveys,” paper read be- 
fore Institute of Mathematical Statistics, Seattle, 
Washington, November 26-27, 1948). Mc- 
Carthy finds that most of the studies of this 
subject deal with other than opinion questions 
and that there is a great dearth of data re- 
garding the difference between opinion data 
secured on first calls and data from callbacks, 
refusals, and unavailable people. The present 


This content downloaded from 216.165.126.13 on Sun, 28 Aug 2016 01:17:17 UTC 
All use subject to http://about.jstor.org/terms 


488 


opinions it is always a question as to 
how the attitudes of the particular indi- 
viduals scheduled for interview through 
the requirements of the sample differ 
from the same classes of individuals 
actually interviewed. A subsidiary ques- 
tion of interest in planning field work 
is the reason why the hard-to-reach are 
hard to reach. The present paper re- 
ports the results of a follow-up field 
study designed to throw some light on 
these questions. 


A Follow-up on 
Hard-to-Reach Individuals 

In May 1948, a field study? to deter- 
mine prestige leadership and influence 
patterns in Mount Vernon, Washington, 
was undertaken by the Department of 
Sociology in collaboration with the Pub- 
lic Opinion Laboratory. Three men and 
two women graduate students in Soci- 
ology participated in the follow-up 
study, which took place three months 
later. Four of them had worked as in- 
terviewers on the original study and 
the experience of the fifth included pro- 
fessional interviewing with market re- 
search agencies. In all, the five inter- 
viewers worked three days in tracing 
down 169 households and obtaining in- 
terviews in 44 of them. 

According to the United States census 
of 1940, the population of Mount Ver- 
non was 4,937. From these figures it 
was estimated that about 3100 adults 
between the ages of 15 and 70 were in 
the city at the time of our canvass. Our 
study secured a total of 1739 completed 
schedules representing that many indi- 
viduals. Some of these interviews were 
with high school students and others 
who lived just outside the city. Thus we 
estimate that we failed for various rea- 
sons to contact about half of the people 
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in the above age groups ordinarily re- 
siding in the city, although we called at 
all known places of residence one or 
more times. 

In order to form some estimate of 
the characteristics of this group of hard- 
to-reach persons, we assembled from the 
state census list of April 1947, the cards 
of all households which we failed to 
interview, totaling about 600 house- 
holds, and drew from this group a 
random sample of 200 for a special fol- 
low-up to determine, if possible, (1) 
why we failed to reach them through 
repeated previous calls, (2) how these 
people differed, if at all, in personal 
characteristics from the group inter- 
viewed, and finally, (3) to interview 
them with the same schedule used on 
the rest of the population to detect any 
bias in our conclusions from the main 
study due to the non-inclusion of the 
persons not reached. 

To test the feasibility of securing this 
kind of data through mailed question- 
naires, we first sent the schedule with 
stamped return envelopes to the entire 
200 with the following letter: 


“We recently conducted a survey of 


paper will, therefore, merely report our ex- 
perience in a field study rather than sum- 
marize the data of other studies or enter into 
the theoretical problems of sampling and er- 
ror involved, which have been competently 
discussed by the authors cited above and by 
F. F. Stephan (“Sampling Errors and Inter- 
pretation of Social Data Ordered in Time and 
Space,” Journal of the American Statistical 
Association, Supplement 31, 185-A, pp. 165-66, 
March 1934; See also Deming, W., and 
Stephan, F. F. “On the Interpretation of 
Censuses as Samples,” Journal of the Ameri- 
can Statistical Association, Vol. 36, March 
1941). 

2 Bassett, R. E., “Measurement of Status in 
Mount Vernon, Washington,” Ph.D. thesis, 
University of Washington Library, 1948. 
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Mount Vernon in the course of which 
some 1,800 people gave us the infor- 
mation called for in the enclosed 
questionnaire. You are one of a few 
whom we failed to find at home at 
the time of our canvass, and we 
would greatly appreciate it if you 
would, at your early convenience, fill 
out the schedule and return it to us 
in the enclosed envelope. 

“We should like to emphasize 
again that all information you give 
will be held strictly confidential, and 


will contribute greatly to the success 
of a scientific study of the com- 
munity. 

“Thanks for your cooperation.” 


The Mailed Questionnaire 


Of the 200 questionnaires mailed out 
to our sample it.is possible to account 
for 55 (27.5%) of them. As noted in 
the last item of Table 1, 15 were re- 
turned completed, 3 were returned in- 
completely filled out and 13 more re- 
turned by the postoffice; in addition, 14 


TABLE 1r 


REsuLTs OF A FoLLOw-uUP SURVEY OF A SAMPLE OF 200 CASES OF 
“HARD-TO-REACH PERsons MissED IN ORIGINAL SURVEY 


Interviewed: 4A 
Refusals: Personal identity and place of residence established but persons 
contacted refused to be interviewed 30 
Moved: Moved away from given address to some place outside or away 
from city 28 
Not Available: Definitely in town. Address located. Some information 
from neighbors, etc. But no arrangements for interviewing could 
be made in time allotted (3 days) 16 
Too Old: Persons on cards contacted and definite information secured 
to indicate they were over 70 13 
Can’t Locate: Persons not at address specified. No definite information 
from present occupants, neighbors, police, county clerk, utilities, 
etc., as to whereabouts 12 
Already Interviewed: Persons contacted claimed that they or someone 
listed on card had been interviewed in original survey 0 
Transient: Persons listed have or still do use the given address but work 
elsewhere (travel) and are only there occasionally 6 
On Vacation: (At time of follow-up) 5 
Too Young: Persons listed on card below 15 years of age and no other 
adult person with same last name at that address 3 
Deceased: 2 
Mail Response: 
Complete 15 
Returned by Postoffice 13 
Returned by respondent incomplete 3 
Total 200 
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of the persons interviewed and 10 of the 
refusals in the follow-up acknowledged 
receiving the questionnaire. Various 
reasons for failing to answer are listed 
in Table 2. The assumption is that the 
other 145 questionnaires were simply 
ignored, 

Seven men and eight women re- 
sponded to the mail questionnaire, a 7.5 
per cent return. Three of these respond- 
ents were schoolteachers and_ the 
others listed occupations similar to 
those noted in the original and follow- 
up interviews, such as, carpenter, truck 
driver, nurse, accountant, and house- 
wife. Eight of these fifteen respondents 
checked their age as being between 30- 
44, which was also the modal age-cate- 
gory of respondents in the original 
study. While the mail respondents des- 
ignated a mean of 11.9 names per sched- 
ule, which is slightly higher than the 
mean number of designations in the 
original or follow-up interviews, no 
special characteristics of the general pat- 
tern of response to the sociometric or 
the background questions are apparent. 

The following comments on the mail 
questionnaires were made by 14 of the 
44 interviewed in the follow-up: 
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In the nature of the case it was also 
impossible to get extensive comment 
about the mailed questionnaire from the 
Refusals, The following brief remarks 
about the mail questionnaire from peo- 
ple who refused to be interviewed were 
noted: 

Didn’t receive any. 

Didn’t bother with it. 

Didn’t think my opinion was neces- 

sary so didn’t fill it out. 

Received it but think it is an un- 

necessary undertaking. 

My husband threw it away as soon as 

he saw what it was. 

The general conclusion, considering 
the size of the return, is that it is use- 
less to attempt to conduct an inquiry of 
this kind by mail questionnaires. 


The “Not Availables’”’ 


What are some of the difficulties en- 
countered in failing to reach the hard- 
to-reach, such as the 16 cases that were 
classed as “Not Available” in Table 1° 
These cases, constituting 8 per cent of 
our follow-up sample of 200, are of 
interest because they represent the larg- 
est and possibly the only group within 
our classification from which additional 
interviews might have been secured. 


TABLE 2 


REASONS FOR FAILING TO ANSWER MaIL QUESTIONNAIRE 


Comments Number of Cases 

Got it but didn’t get around to answering it 4 
New in town and don’t know any names 2 
Didn’t receive any 2 
Thought the questions too silly to answer 2 
Was just going to mail it in 7) 
Didn’t understand it I 
Know too many people and can’t choose between them I 

Total 14 
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The process of tracing down people 
who had changed residence within the 
city introduced a time and effort cost 
of some importance throughout this 
follow-up survey. Four such cases were 
encountered among the Not Availables, 
each requiring several “check calls” 
with neighbors, public officials, etc., be- 
fore their place of residence could defi- 
nitely be established. To illustrate the 
expenditure of effort necessary to estab- 
lish a Not Available we quote here 
from the interviewer’s log on a case we 
shall call “John Doe” of 113 A street: 


August 3: Called at house. Not at 
home. One neighbor says he works 
at bowling alley. Second neighbor 
says John Doe moved a month ago 
and now lives out on main high- 
way at Bob’s Auto Court. 

August 4: Called at bowling alley— 
it is closed for repairs until August 
9, No one around. Called at auto 
court. Manager doesn’t remember 
or have any record of tenant named 
John Doe. 

August 5: Telephoned residence. 
Present occupant says Doe moved 
July 15 and they don’t know where. 
Owner of sport shop next to bowl- 
ing alley says Doe is now staying in 
room at 1615 B street... . “Don’t 
tell ’em that I sent you, they work 
late and are probably sleeping.” 


Called at 1615 B street, no one 
answers door, shades drawn. (11:30 
a.m. 2:30 p.m. and 3:30 p.m.) Next 
door neighbor confirms that this is 
address of John Doe. 


In this case, place of residence was 
not established until the last day of the 
interviewing period and only two call- 
backs were possible. For most of the 
other Not Availables place of residence 
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was established earlier and at least two 
callbacks at different times on each of 
successive days for each case were made. 

The only evidence we have on why 
these people were not available comes 
from comments of neighbors. Generally 
these remarks were brief, merely indi- 
cating that the person in question had 
a job and works “down at the laundry,” 
“in the bowling alley,” “over at the 
Palace billiards,” or “at the hospital.” 
Attempts were made in several in- 
stances to make contact at the place of 
employment but generally because of 
the hours of employment, this was not 
very successful. This seems to indicate 
that in a population of this sort there is 
a sizeable number of prospective re- 
spondents who, because of the nature 
of their employment, are not readily 
available for interviewing. 


The Refusals 


Thirty people, or 15 per cent of the 
initial follow-up sample, refused out- 
right to be interviewed. Ten others, 
listed in Table 1 as “Already Inter- 
viewed,” might conceivably be consid- 
ered refusals as a later check revealed 
they had not been interviewed during 
the original survey. In either case, the 
refusal rate (defined in the original 
study as the number of refusals divided 
by the number of interviews completed), 
which was 21.7 in the original survey, 
was more than three times as great in 
the follow-up, or 68.1. 

When the interviewers tried to find 
out the reason for the refusals, the usual 
answer was “too busy” or “can’t be 
bothered.” Five people closed the in- 
terview without adding any words of 
explanation. Five others claimed ignor- 
ance of community affairs, “don’t know 
anyone town.” Three people objected 
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to the content of the schedule, calling 
it “outlandish,” “too personal,” or com- 
menting, “all them professor’s got to 
do is think up silly questions and I 
can’t see no sense to it.” And in two 
cases there were repeated callbacks be- 
fore it was definitely established that 
the sought-after persons were at home 
but would not answer the knock on the 
door. 

The following brief responses to the 
inquiry regarding the Refusals’ where- 
abouts in May were noted by the inter- 
viewers before personal contact was 
closed. 

Working. 

Don’t remember. 

Just not around. 

Refused then too. 

Was visiting at a friend’s house and 

saw her interviewed. 

Guess I was out shopping. 

We were in Ohio on business. 

We were out of town or didn’t 

answer the bell. 

She was hiding in the washroom un- 

til you left. 

The suggestion to Refusals that an 
appointment be made for an interview 
at a more convenient time was also re- 
jected. It was noted, further, that sev- 
eral of the Refusals lived in residences 
also used as business enterprises, such 
as a beauty parlor, fuel office, transport 
company, and gasoline station. 


The Interviews 


Forty-four people, representing 26 
per cent of the 169 cases remaining in 
the sample after deducting the 31 cases 
accounted for by the mail questionnaire 
(see Table 1), were successfully inter- 
viewed in the field with the original 
schedule. The following remarks as 
to the probable reasons for our failure 
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to secure an interview in the original 
survey were recorded (see Table 3): 


TABLE 3 


PROBABLE REASONS FOR FAILING TO 
REAcH PERSONS IN ORIGINAL SURVEY 


Reason stated Number of cases 


Working 15 
Just don’t know 10 
No answer 5 
Sick 4 
Visiting out of city 3 
Probably working in garden 2 
Busy in house I 
Moving within city to new 
residence I 
No one called here I 
Attending club meeting I 
Called upon but refused I 


Total 44 


Further analysis of the interviewers’ 
reports indicates that after the residence 
of each respondent was established it 
was necessary to make 68 calls to ob- 
tain 44 interviews. Thus one callback 
for every other interview, on the aver- 
age, was necessary. This may not be 
considered an extremely high callback 
rate, but it must be remembered that 
we reached only 44 out of a sample of 
169 through this amount of follow-ups. 
The determination of the non-avail- 
ability of the remainder, as shown in 
Table 1, required much additional in- 
vestigation. It should be noted, too, that 
four of the respondents were inter- 
viewed away from their home at their 
place of business or work. Many of the 
others were interviewed at times of day 
other than those used in the original 
canvass. 
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Characteristics of the Hard-to-Reach 


The 44 cases successfully interviewed 
in the follow-up study represent too 
small a number for the computation of 
percentages of much reliability for com- 
parison with the percentages of the 
original study. However, analysis of 
the schedules of the persons interviewed 
in the follow-up (Table 4) indicates 
no striking difference between the two 
groups, except in the proportion of the 
sexes reached. 
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While more women than men were 
interviewed in both cases, the percent- 
age of women interviewed among the 
hard-to-reach was considerably greater. 
It would appear that even among the 
hard-to-reach, women are the easier to 
reach for interviewing. 

In its age composition the original 
study sample fairly well met the re- 
quirements of representativeness as 
gauged by census data (see Bassett, op. 
cit., pp. 107-109). When the three age 


TABLE 4 


CoMPARISON OF SAMPLES 


CHARACTERISTICS OF RESPONDENTS REACHED 


PER CENT OF SAMPLE 


Original Study Follow-up Study 
%o N %o N 

Sex: Male 44.6% (597) 22.7% (10) 
Female 55-4 (742) 77:3 (34) 
Age: 20-59 80.9 (1083) 79.6 (35) 
60 and over 17.9 (239) 11.3 (5) 
Married: 81.3. (1082) 63.6 (28) 
Education: Beyond high school 32.1 (420) 25.0 (11) 
Residence: More than 5 years in Mt. Vernon 66.7. (842) 70.5 (31) 
Social Participation Score: (Chapin’s) Under16 67.8 (907) 75.0 (33) 
Magazine Readership: Read Magazine “A” rrr (148) 1.3 (5) 
Read Magazine “B” 24.5 (328) 29.5 °&# (13) 
Read Neither “A” nor “B” 40.5 (541) 40.9 #8 (18) 
Read Both “A” and “B” = 23.8 = (319) 18.1 ( 8) 

Opinions About Price Trends: 
Higher 44.2 (592) 52.2 (23) 
Not so high 7.1 ( 95) 6.8 ( 3) 
About the same 41.7 (558) 18.1 ( 8) 
Don’t know 70 (94) 22.9 ~# (10) 
Opinions About War: Within 5 years 38.0 (509) 25.0 (11) 
Within 25 years 32.0 (429) 29.5 &# (13) 
Not within 25 years 8.1 (109) g.1 ( 4) 
Don’t know 21.8 (292) 36.4 (16) 
N= 1339 cases 44 cases 
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categories between 20 and 50 for the 
hard-to-reach are grouped together the 
total percentage very nearly equals that 
of the original study for the same span. 
In no case in any of the seven age cate- 
gories used on the schedule does the 
percentage difference between the hard- 
to-reach and the original group exceed 
Il per cent. In general, however, the 
hard-to-reach tend to be younger in age. 

It will be noted further from Table 4 
that there is a slightly greater percent- 
age of the hard-to-reach with scores 
under 16 on Chapin’s Social Participa- 
tion Scale. The score 16 was selected for 
comparison for it was found in Mount 
Vernon to divide leaders and office hold- 
ers from non-leaders and _ non-office 
holders and to divide respondents ac- 
cording to age, sex, length of residence, 
and schooling. 

Further comparison suggests that the 
hard-to-reach have lived in Mount Ver- 
non at least as long as the original- 
study respondents, but the hard-to-reach 
do not seek formal education beyond 
high school in as great a proportion, 
nor is the percentage married as high 
among the hard-to-reach. The striking 
similarity of percentages in the maga- 
zine reading preferences of the two 
samples seems to indicate a similarity 
of taste of the two groups in this re- 
spect. 

In all but three of the forty-four 
hard-to-reach households the head of 
the household was regularly employed. 
(Fourteen of the hard-to-reach respond- 
ents called themselves “head of the 
household.”) The occupations of the 
hard-to-reach ranged through all the 
census classifications from managers to 
domestic servants with the greatest 
number, fourteen, concentrated in jobs 
with a skilled classification. While per- 
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centage comparisons between the hard- 
to-reach and the original-study groups 
are not possible, there is little evidence 
to indicate that the hard-to-reach have 
a unique pattern of occupational status 
that deviates sharply from that of the 
original study. 

In response to the eight questions re- 
garding prestige leadership and influ- 
ence, it was possible for a respondent 
to designate a maximum of 15 names. 
The mean number of designations per 
schedule for the original study was 9.2 
for the home interviews and 10.6 for 
the business district interviews. The 
hard-to-reach respondents designated an 
average of 7.7 names per schedule. 

The answers of the hard-to-reach to 
questions indicating prestige leadership 
in the community tended to correspond 
closely with the answers of respondents 
in the original study. No new names 
were mentioned by the hard-to-reach as 
“business leaders,” “important men and 
women,” etc. Further, no hard-to-reach 
respondent was named as a prestige 
leader by any of the other hard-to-reach 
respondents. 

The answers of the hard-to-reach re- 
garding questions of interpersonal in- 
fluence were also in general similar to 
the answers of the original group. In 
no case did one hard-to-reach respond- 
ent name another hard-to-reach re- 
spondent in reply to these questions of 
the sociometric type. 

The conclusion is that, on the whole, 
the personal characteristics and re- 
sponses of the hard-to-reach, as far as 
determined by this follow-up, were 
not markedly different from those of 
the main group interviewed. Nor is 
there any evidence that the hard-to-reach 
constitute a special social group making 
choices largely among themselves. 
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